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Abstract 

This paper provides some reflections on the field of mathematical soft- 
ware on the occasion of John Rice's 65th birthday. I describe some of the 
common themes of research in this field and recall some significant events 
in its evolution. Finally, I raise a number of issues that are of concern to 
future developments. 



1 Introduction 

1.1 The study of mathematical software 

The field of mathematical software is concerned with the science and engineer- 
ing of solving mathematical problems with computers. The primary focus is 
the development of general-purpose software tools applicable to problems in a 
variety of disciplines. There are a large number of facets to this work, including 
the following. 

• the development and analysis of algorithms for standard mathematical 
problems which occur in a wide variety of applications 

• the practical implementation of mathematical algorithms on computing 
devices, including study of interactions with particular hardware and soft- 
ware systems 

• the environment for the construction of mathematical software, such as 
computer arithmetic systems, languages, and related software develop- 
ment tools 
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• software design for mathematical computation systems, including user in- 
terfaces 

• testing and evaluation of mathematical software, including methodologies, 
tools, testbeds, and studies of particular systems 

• issues related to the dissemination and maintenance of mathematical soft- 
ware 

In 1977 John Rice aptly characterized the need for specialized study in this 
area with the following observation |]6^ . 

Many sophisticated scientists produce naive software just as many 
sophisticated computer programmers produce naive science. 

Tremendous progress has been made in the mathematical software field in the 
past 25 years. Yet, there continues to be a wide range of quality in existing 
software, in both the research and commercial domains. Good mathematical 
software results from the application of certain principles, methodologies, and 
practices derived from both applied mathematics and computer science. The 
study of these principles and practices is central to the field of mathematical 
software. To this end, typical software engineering practices, while beneficial 
to the production of mathematical software systems, are not sufficient. Math- 
ematical software operates in the milieu of scientific computing, which has a 
number of characteristics that distinguish it from other areas. Among these are 
the following. 

• Floating-point arithmetic. Most scientific computations are performed 
with floating-point arithmetic. Consequently, rounding errors occur in 
most arithmetic operations. Mathematical algorithms, therefore, must 
not only be correct in a strict mathematical sense, but they must control 
the accumulation of round-off, avoid catastrophic loss of significance from 
the subtraction of like quantities, and avoid unnecessary overflows and 
underflows. Such problems are sometimes unavoidable; software systems 
must be designed so that they do not fail when these anomalies do occur. 

• Approximations. Floating-point arithmetic certainly implies approx- 
imation at a very fine level. However, more substantial approximations 
occur in mathematical computation. Infinite series are truncated, difficult- 
to-compute functions are approximated by polynomials, derivatives are 
approximated by differences, integrals are approximated by finite sums, 
curved domains are approximated by polygonal ones. The combined effect 
of such approximations on the final result can be quite difficult to assess. 
Analysis must be used to show that the correct solution is obtained as the 
approximations are made more precise (i.e., that the algorithm is conver- 
gent). However, good software must do more. It must provide mechanisms 
for a user to assess the quality of the result, and to alert the user when 
the result is suspect. Well engineered software can use such metrics to 
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automatically control the level of approximations, optimally adapting the 
algorithm to the situation at hand. 

• Infinite processes. Many mathematical computations consist of apply- 
ing some infinite process that obtains the desired result only in the limit. 
Such processes must be truncated for practical use. Considerable research 
efforts have been involved in finding iterations that converge quickly. De- 
ciding when to stop is always a difficult problem of practical concern to 
software developers. Good software must employ techniques that detect 
divergence or too slow convergence and take appropriate action. 

Coupled with these fundamental mathematical challenges are practical con- 
cerns about portability. How can developers produce software with reliable, 
reproducible behavior when it must run in very different environments, with 
different types of processor architectures, arithmetic systems, memory hierar- 
chies, operating systems, and language processors? Such questions are critical 
in the study of mathematical software. 



1.2 The contributions of John R. Rice 

At this conference, we are celebrating John Rice's long and influential research 
career. John has made fundamental contributions to the areas of approximation 
theory, numerical analysis, mathematical software, and computer science. In 
the area of mathematical software, his technical contributions have had three 
overriding themes. 

1. Architecture of scientific software systems. John has participated in 
the design and development of a variety of widely distributed mathemat- 
ical software systems |4[ In the course of this work 
he pioneered a number of design concepts which have influenced many 
systems. Among these are poly algorithms meta- algorithms and 
software parts fz^ . 

2. Raising the level of abstraction. Software users are more efhcient 
when they can express their computational needs in the language of their 
technical field. For applied mathematics, abstractions are based upon 
concepts of the calculus, not simple arithmetic operations encapsulated 
in programming languages like Fortran. John Rice's work in high-level 
components and languages [7^ |72|, intelligent interfaces g^, |4^, ^, and 



problem-solving environments ||29|, ^ have served to push abstractions to 
higher and higher levels. 

3. Understanding software via experimentation. Understanding the 
behavior of software is necessary in order to make practical decisions re- 
garding algorithm selection j6^. John has often stressed the importance 
of the use of experimentation in such evaluations. The many small engi- 
neering decisions made in the course of translating an abstract algorithm 
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into a working computer program can have an enormous impact on its 
performance characteristics. John has devoted much time to developing 
testing and evaluation methodology ^ ^ and applying it to 

particular situations |2^, ^ |6^. Indeed, one of the principle appli- 
cations of the ELLPACK system ]70[| and its successors has been to the 
performance evaluation of software for partial differential equations. 

John's contributions to the field of mathematical software have been volu- 
minous and far-reaching. (In this paper I have only cited a few examples of his 
many writings on this subject.) In the remainder of this paper I will enumerate 
some of the major events in math software, pointing out some of John's key 
contributions along the way. I will then describe several current issues facing 
the field and make several hazy predictions of the future. 

2 Mathematical Software Past 
2.1 Beginnings 

The earliest applications of electronic computers were in science and engineering, 
for which mathematical computation played a central role. Programming was 
a very difficult chore, done without modern aids like high-level languages, com- 
pilers and debuggers. The first publication of a piece of mathematical software 
in a research journal probably occurred in 1949, when Mathematical Tables and 
Other Aids to Computation printed a UNIVAC code for the solution of Laplace's 
equation written in machine language . Such codes were very difficult to pro- 
duce, and the need for reuse of software was recognized very early on. In 1951, 
Wilkes, Wheeler and Gill presented one of the earliest program libraries, which 
was developed for the EDSACQ |8|. 

By the 1960s, the introduction of high-level programming languages, e.g. 
Algol and Fortran, had greatly eased the task of producing reusable mathemat- 
ical software. The use of such languages was not without controversy, of course. 
Compiled code was not quite as efficient as hand-tuned assembly code, but most 
people were willing to accept this in light of the great savings in programmer 
time. Also, the subprogram structure provided by these languages provided a 
simple framework for the construction and maintenance of libraries of utilities. 

In 1960, the Association for Computing Machinery (ACM) began a new 
editorial department in the Communications of the ACM (CACM) devoted to 
the publishing of algorithms. Edited by J. H. Wegstein of the National Bureau of 
Standards (NBS), this section printed the code of contributed Algol procedures 
(most such codes were quite short). Also, remarks on and certifications of 
previously published codes were solicited. The first such contribution was a 
code for numerical quadrature submitted by R. J. Herbold of NBS Each 

^The EDS AC (Electronic Delay Storage Automatic Computer) was built in the late 1940s 
at the Mathematical Laboratory of the University of Cambridge. It was operational from 1949 
until 1958. 
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algorithm was given a number, and the set of algorithms later became known 
as the Collected Algorithms of the ACM (CALGO). 

Computer manufacturers also began to develop libraries for their users. The 
most prominent of these was probably the IBM Scientific Software Package 
(SSP). A number of laboratories, such as Bell Labs, Boeing, Harwell, and Mon- 
santo, began the development of math software libraries for their internal use. 
Several organizations, such as SHARE, the IBM user's group, began to collect 
such utilities for redistribution. 

Of course, subroutine libraries were not the only focus of researchers in this 
new field. Some were imagining ways in which these new powerful computers 
could be used to transform the way in which applied mathematics was practiced. 
Many of these ideas were discussed at the Symposium on Interactive Systems for 
Experimental Applied Mathematics held in in Washington, D.C. in August 1967 
The vision there is remarkably clear; many of the participants reported 
on developments in technologies which would only finally begin to be realized 
in the 1980s and 1990s. At Purdue, for example, John Rice, Saul Rosen and 
colleagues designed NAPSS (Numerical Analysis Problem-Solving System), an 
interactive mathematical problem-solving system which would accept input akin 
to normal mathematical notation fn\ , and would employ a variety of heuristics 
to automate numerical analysis. Unfortunately, the resources necessary for such 
an ambitious system exceeded even the supercomputers of the day (like the CDC 
6400), and a fully functional system was never realized. 

2.2 A community emerges 

Perhaps the first event that provided a real sense of community for researchers 
interested in the production and dissemination of reusable mathematical soft- 
ware was the Mathematical Software Symposium held at Purdue University in 
April 1970. John Rice organized the symposium]^ which was sponsored by 
ACM and the Ofhce of Naval Research, and the proceedings were published as 
a book by Academic Press ||6^. Included in the proceedings were 23 papers, 
four descriptions of selected mathematical software, and more than 40 pages of 
introductory material prepared by Rice. 

One of the recommendations from the Symposium was for the establishment 
of a journal that would publish papers related to mathematical software. John 
Rice vigorously pursued this possibility]^ After considerable negotiations with 
ACM and the Society for Industrial and Applied Mathematics (SI AM), ACM 
agreed to publish the new journal. Papers from an NSF-sponsored conference 
were used to provide articles to seed the journal. Mathematical Software II 
was held at Purdue in May 1974. There were 225 attendees, with 82 papers 
presented. The best of those papers make up the majority of the first volume 
of the ACM Transactions on Mathematical Software (TOMS) which published 

^The organizing committee included Robert Asheniiurst, Cliarles Lawson, M. Stuart Lynn, 
and Joseph Traub 

•^A committee that included Wayne Cowcll, Lloyd Fosdick, Tom Hull, M. Stuart Lynn, and 
Joseph Traub worked with him. 
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its first issue in 1975 with John Rice as Editor-in-Chicf. John continued in that 
position until 1993. 

TOMS was chartered not only to publish traditional research papers, but 
also algorithms (with included code which would be refereed), certifications, 
translations, and remarks on previously published algorithms. The Algorithms 
section of CACM was moved to TOMS, and hence TOMS algorithms were 
numbered beginning at 493. One of the important features of the new journal 
was the establishment of a reliable Algorithms Distribution Service for CALGO. 
The distribution, on magnetic tape, was performed on a cost-recovery basis by 
IMSL, Inc. Obtaining software in machine-readable form was much more useful 
than reading code on paper. This also allowed TOMS to adopt the policy of 
not printing the code of algorithms in the pages of its journal, thus saving much 
in production costs. 

A third conference organized by John Rice, Mathematical Software III, was 
held at University of Wisconsin in 1977 By the end of the decade, mathe- 
matical software had emerged as a viable research area with an active community 
to support it. After publishing 25 volumes, TOMS remains a vibrant outlet for 
the work of this community . 



2.3 Software emerges 

Another important activity in the 1970s were the numerous efforts to develop 
carefully constructed, systematized collections of mathematical software. One of 
the first of these was the NATS project, the National Activity to Test Software, 
which was conceived in 1970. A joint venture of Argonne National Laboratory, 
Stanford University, and the University of Texas at Austin, NATS was designed 
to study problems in producing, certifying, distributing, and maintaining quality 
numerical software. A key part of this effort was the production of two Fortran 



software packages, EISPACK |30|, 75 for eigenvalue problems, and FUNPACK 
[ p^ for special functions. 

EISPACK, which first appeared in 1972, was based upon algorithms pub- 
lished in the 1960s in Numerische Mathematik and later collected by Wilkinson 
and Reinsch in the Handbook for Automatic Computation [ p3[ . Although the 
core of EISPACK was largely a Fortran translation of these existing Algol codes, 
the project was enormously influential. It set a new standard for quality trans- 
portable mathematical software, rigorously tested in a wide variety of computing 
environments. Its success inspired the development of many systematized collec- 
tions, or "PACKs", in other areas: LINPACK for linear systems [|l9|, FISHPAK 
for separable elliptic problems DeBoor's B-spline interpolation package JTzt , 
MINPACK for nonlinear systems |5^, DEPAC for ordinary differential equa- 
tions [0, FuUerton's function library FNLIB |||, Swarztrauber's FFTPACK 
for fast Fourier transforms |Q , and QUAD PACK for numerical quadrature |^ . 

Of all the early "PACKs" , LINPACK undoubtably saw the most widespread 
use. One of the keys to LINPACK's success was the decision to base its coding 
on the newly proposed Basic Linear Algebra Subprograms (BLAS) The 
BLAS performed elementary vector operations, such as norms, dot products. 



6 



scaling, and vector sums. The innermost loops in LINPACK's column-oriented 
algorithms occurred inside the BLAS. This allowed optimization of the whole 
package by simply optimizing the BLAS. This approach proved quite successful, 
and many machine-specific versions of the BLAS were developed and supported 
by computer manufacturers. 

The 1970s also saw great advances in software for ordinary differential equa- 
tions (ODEs). Gear's code DIFSUB |3l| provided a well designed framework 
for automatic integration of both stiff and non-stiff problems using linear multi- 
step methods. Shampine and Gordon's ODE |7|] did the same for Runge-Kutta 
methods. Many subsequent packages were built using these basic designs. Other 
influential packages included COLSYS for two-point boundary-value problems 
[H and DASSlQ for differential algebraic systems . 

A number of high quality multi-purpose libraries also had their start in the 
1970s. In 1970, six British computing centers began an effort to develop a 
library for their ICL 1906A/S computers. The next year Mark 1 of the Not- 
tingham Algorithm's Group (NAG) library was released. Implementations for 
other systems followed, and in 1976 a not-for-profit company, Numerical Algo- 
rithms Group, Ltd., was formed to continue development and distribution. The 
NAG effort continues today |5^. The first commercial math library effort was 
also begun in 1970 with the incorporation in Houston, Texas of IMSL, Inc. by 
Charles W. Johnson and Edward Battiste. By the time the company showed its 
first profit in 1976, there were 430 library subscribers; the IMSL library remains 
a viable commercial product |Q. Bell Laboratories also developed a library, 
PORT, whose single-source approach to portability influenced many subsequent 
efforts 

The development of ELLPACK, a system for elliptic boundary- value prob- 
lems, also began in the mid 1970s. This effort, which was led by John Rice, was 
a cooperative project of Purdue University, the University of Texas at Austin, 
Yale University, and others. In ELLPACK, the solution process was partitioned 
into a number of distinct phases (domain processing, discretization, indexing, 
linear system solution, and output), and the interfaces between these phases 
were carefully defined. This design allowed the development of a large library 
of components which could be easily composed to build algorithms for solving 
particular problems. ELLPACK also proved to be an excellent testbed for the 
evaluation of software for elliptic problems. To ease the use of the system, John 
Rice designed a very-high-level language to describe the problem to be solved, 
and to select the components to be used to solve it. The system first became 
fully operational in 1978 Many of the basic concepts in ELLPACK's design, 
such as high-level user interfaces and plug-and-play software parts technology, 
are in common use in modern problem-solving environments. 

The development of mathematical software in the 1970s and early 1980s 
is described in detail in the book Sources and Development of Mathematical 
Software edited by Wayne Cowell Q . 



^DASSL won the 1991 Wilkinson Prize for Numerical Software 
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2.4 Increased access 



By the beginning of the 1980s a substantial collection of mathematical soft- 
ware, mostly in the form of Fortran subprograms, was available for use. The 
user base for this software had grown substantially, and with it came a new 
problem: how to locate that needed software component. The National Bureau 
of Standards (now NIST) developed an extensive catalog of such software. Their 
Guide to Available Mathematical Software (GAMS), based upon a detailed 
tree-structured problem-oriented classification system [|l^, allowed readers to 
see which components of which libraries and packages, both public domain and 
commercial, were available to solve each problem. The catalog remains available 
today as an online resource Q . 

Another barrier to the widespread use of software developed by the research 
community was simply the process of obtaining the code. One had to locate the 
author, request a magnetic tape, and attempt to decipher its format. Useful 
software was often lost to the community when an author changed institutions 
and there was no longer support for distributing it. In 1985, Jack Dongarra, 
then at Argonne National Labs, and Eric Grosse at Bell Labs, started a software 
repository they called netlib Q , which pioneered the use of computer networks 
in software distribution. Software could be obtained automatically by return 
email after sending requests to an address whose email was processed by a 
Unix daemon. The ready availability of such software changed the way in which 
many researchers worked. Many more made routine use of high quality software, 
and many others were freed of the necessity of maintaining their own private 
repositories. Now Web-accessible and supported by the University of Tennessee 
at Knoxville and Bell Labs, with mirrors worldwide, netlib remains the premier 
repository of software developed by the mathematical software community Jill . 

The 1980s also saw the first commercial success for general-purpose interac- 
tive systems for mathematics. A system for matrix computations developed as 
a teaching aid during the period 1977-84 by Cleve Moler at the University of 
New Mexico, was commercialized as a tool for control system engineers. Today 
MATLAB is a very popular system for scientific computing The overall 

structure of modern interactive mathematics systems was greatly influenced by 
the system Mathematica developed by Stephen Wolfram in 1988 |Q. Mathe- 
matica was the first commercial system to integrate symbolic, numerical, and 
graphical capabilities into a single package. The growing availability of per- 
sonal computers and workstations was an important factor in the success of 
these systems. With these tools, the use of mathematical software was begin- 
ning to expand to those with little experience in numerical methods or even 
programming. 

2.5 New architectures 

The 1980s also brought vector and parallel computers into widespread use, and 
with them additional challenges to the design of mathematical software. Vec- 
tor processor vendors developed specialized math libraries tuned for their sys- 
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terns, mainly containing software for linear systems and FFTs. These solutions 
emerged because the performance of linear algebra software such as LINPACK 
was disappointing on vector register architectures like the Cray and Convex. 
The main reason for this was the fact that moving data from memory to vec- 
tor registers was very costly, and that LINPACK's column-oriented algorithms, 
based on the BLAS, necessitated more data movement than was really necessary. 

In 1984 John Rice hosted a workshop at Purdue ("ParVec Workshop Num- 
ber 4" ) in which a variety of schemes for developing portable high-performance 
software for vector parallel systems were proposed ||6^ . Jack Dongarra and Sven 
Hammarling proposed the development of new classes of BLAS: Level 2 BLAS 
for matrix-vector operations, and Level 3 BLAS for matrix-matrix operations. 
Encapsulating O(n^) and 0{n^) operations, respectively, as fundamental opera- 
tions would provide much more opportunity to optimize core operations on dif- 
ferent processors. These new BLAS ||2^, ^ would provide the basis for a major 
new linear algebra package released in 1992. LAPACK which included the 
functionality of both EISPACK and LINPACK, used block-oriented algorithms 
in which the fundamental operations were now matrix operations encapsulated 
in the Level 3 BLAS. These have proven to be highly efficient on modern vector 
processors and symmetric multiprocessors. Every major computer manufac- 
turer now supports tuned BLAS for their systems and incorporates LAPACK 
in their math library. Community efforts are currently underway to extend the 
BLAS in new directions, such as sparse matrix operations Q 

In the late 1980s multiprocessor systems of widely differing design were be- 
coming routinely available, and with them a host of new programming models, 
supported by specialized message-passing primitives. Developing portable soft- 
ware for the class of distributed memory (multiple instruction multiple data, or 
MIMD) systems became a new challenge. The PVM system developed in 1991 
provided a useful abstraction for parallel programming and was very widely 
adopted p2| . Its implementation on many parallel machines demonstrated the 
usefulness and feasibility of a common message-passing infrastructure. This 
led to a grass root message-passing standardization effort. The resulting Mes- 
sage Passing Interface (MPI) transformed the landscape for distributed parallel 
computing 

One of the first portable math software libraries for distributed architectures 
was ScaLAPACK, a distributed memory counterpart of LAPACK linear system 
solvers §. This package became the core of several multi-purpose distributed 
memory math software libraries which first appeared in the 1990s. Among 
these are the NAG Parallel Library H, IBM's PESSL ||l|l, and the European 
PINEAPL effort ||. 

The increasing complexity of scientific software systems being developed in 
the 1990s led to an interest in new software architectures. Object-oriented ap- 
proaches to the development of mathematical software began to be seriously 
considered. The notorious inefRciencies of pure object-oriented design, and the 
lack of language standardization made such pursuits difficult. Nevertheless, ap- 
proaches that allowed many of the advantages of object-oriented design without 
sacrificing efficiency were developed. LAPACK++, a subset of the linear sys- 
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terns solvers in LAPACK written in C++, was one of the first such successful 
packages |l^. Today object-oriented approaches are routinely used in scientific 
computing. 

2.6 Expanding vision 

By the 1990s, rapidly increasing computer power was leading to new visions for 
the future of mathematical software systems. During that period, for example, 
John Rice and colleagues led in the establishment of a new community of re- 
searchers interested in exploiting the promise of expert systems for numerical 
computing. In a series of conferences held at Purdue the use of AI 

approaches for such tasks as algorithm selection, automatic programming, and 
process management were explored. 

By this time, computation had become an essential ingredient in the prac- 
tice of science and engineering. Interest in computational science as a new field 
of study was beginning, and interdisciplinary programs for training its prac- 
titioners were being established in many universities. John Rice and others 
began to develop a new vision for mathematical software systems to support 
computational science research. These systems, called problem- solving environ- 
ments [^9| , ^ , would provide natural graphical user interfaces in which scientists 
describe their problems using the vocabulary of their native discipline. They 
would provide access to rich libraries of problem-solving components enabling 
Web-based parallel and distributed computation. Users would be able to inter- 
act with ongoing computations, to easily visualize results, to manage a large 
database of experimental results, and to ask advice of expert advisory systems. 
Many small-scale special-purpose systems now under development and use can 
be classified as problem-solving environments, and research groups throughout 
the world are working on infrastructure necessary for the routine construction 
and use of such systems. Work at Purdue on parallel ELLPACK Web- 
ELLPACK and PYTHIA Q are serving to address issues in PSE design. 
Examples of current work in network-based scientific computing are Netsolve 
[ p^ , the NEOS optimization server ||l^, and the computational grid [ p5| . 

The vision of scientific computation in heterogeneous distributed environ- 
ments places stringent requirements on the portability and interoperation of 
scientific software that are extremely difficult to achieve [Q. Such needs have 
sparked interest in the use of common virtual environments such as Java|^ for 
computational science and engineering. The Java language and its environment 
(the Java Virtual Machine), which has become available on nearly every comput- 
ing platform, provides a fixed floating-point model, threads, remote execution, 
standard GUIs, and other facilities within a simple object-oriented programming 
language. While these are the main facilities necessary for the construction of 
problem-solving environments, there has been some reluctance to adopt Java 
within the scientific community due to concerns about efficiency and the lack 
of several programming conveniences important to scientists and engineers |^. 

^Java is a trademark of Sun Microsystems. 
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Community efforts such as tlie Java Grande Forum are seeking to improve this 
situation 

Virtual environments do not necessarily solve the problem of performance 
portability, since virtual machine instructions must be mapped on to local com- 
puter hardware for execution. Modern computing hardware is extremely com- 
plex, characterized by multiple processing units, vector pipes, register farms, 
several levels of cache (with increasing access times), local memory, remote 
memory, and disk storage. Getting the highest performance possible requires 
that the programmer take into account all the special properties of the sys- 
tem in use. This leads to extremely complex software even for the simplest of 
tasks. Matrix multiplication can turn into a 10,000-line polyalgorithm. Recent 
approaches have provided new hope for overcoming this software development 
nightmare. Clint Whaley and Jack Dongarra have recently developed a system, 
called ATLAS, for Automatically Tuned Linear Algebra Subprograms [|l). AT- 
LAS generates highly efficient BLAS for a given architecture using an experi- 
mental approach. By running many hundreds of tests, ATLAS determines the 
most efficient way to implement a given operation. The result is consistently 
on par with, and often exceeding, code which takes expert programmers weeks 
to develop. Matteo Frigo and Stephen Johnson have taken a similar approach 
in the computation of fast Fourier transform ||2^. For FFTs, hardware also 
interacts with the prime factorization of the sequence length n to add further 
complication. FFTW, the Fastest Fourier Transform in the West, uses heuris- 
tics and experimentation to develop a just-in-time strategy for fast computation 
for a given n on a given processor.^ 

3 Mathematical Software Present 

In this section I point out a variety of meta-issues that face mathematical soft- 
ware researchers today. 

3.1 Mass-market software 

Until recently mathematical software was produced mostly by experts in nu- 
merical analysis as a byproduct of their research in algorithms. Users of this 
software also were fairly sophisticated, with some experience in numerical algo- 
rithm development themselves. They had an appreciation of the limitations of 
numerical algorithms, and the necessity of careful verification of results, even 
when using software developed by experts. 

Today's community of mathematical software developers and users is much 
larger, and much more diverse. The great demand for mathematical computa- 
tions has made mass-marketed mathematical software profitable. Commercially 
supported mathematical and statistical software is now widely available, with 
high-level interfaces that allow use by non-programmers. Such users often do 

^FFTW won the 1999 Wilkinson Prize for numerical software. 
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not have the background necessary to recognize the difference between a diffi- 
cult problem and a routine one. The mathematical landscape is still littered 
with pitfalls, and these users may be too trusting of the results produced by the 
scientific software systems that they use. Programmers who add mathematical 
and statistical capabilities to commercial software systems are no longer experts 
in numerical analysis. They may be content to code up a formula from a book 
without giving thought to its numerical properties. The problem may be even 
more severe in systems that are not overtly mathematical in nature. Mathe- 
matical computations are increasingly being done in embedded devices, coded 
by programmers whose mathematical sophistication may be suspect. 

As a result, in spite of tremendous progress in numerical methods and soft- 
ware, many users of modern mathematical software are at risk. There is now 
a desperate need for numerical analysts to develop and apply methodologies 
for the validation of mathematical and statistical software. Techniques, tools, 
reference data, and reference software are needed to support critical evaluations 
of mathematical software by developers and users . Unfortunately, there is 
little interest and support within the research community for such activities. 

Those software developers who seek advice regarding numerical software 
production are likely to look to popular sources like Numerical Recipes p5[ . 
Books like this provide a reasonably good introduction to numerical methods, 
and the programs they include provide good examples of the basic techniques. 
Programs like these are often incorporated wholesale into applications, in spite 
of the fact that they are typically less efficient, robust, and reliable than state- 
of-the-art mathematical software. The mathematical software community needs 
more popularizers who can bring the message of good numerical software design 
to those in other fields. 

3.2 Tower of Babel 

For many years there was one language for scientific computing: Fortran. This 
greatly simplified the development and reuse of mathematical software compo- 
nents. Today we are faced with a plethora of programming languages in use 
for scientific computing. Though officially obsolete, Fortran 77 is still the lan- 
guage of many. Good compilers are now available for Fortran 90, and many 
have been extended to support Fortran 95, the current Fortran standard, al- 
though their adoption by programmers has been slow in coming. The C lan- 
guage has proven much more popular, for which excellent compilers are now 
available. Most GAMS users who cannot find the software they seek are look- 
ing for C procedures. C++, the object-oriented extension to C, is the choice 
for a growing number of new mathematical modeling projects. Unfortunately, 
C-| — I- has not, until recently, had an agreed-to standard, and, as a result, de- 
veloping portable software has been difficult. Java, the popular network- aware 
object-oriented programming language developed by Sun, is being seriously con- 
sidered by many, although its performance and language features leave much 
to be desired. The fact that Java is now being widely taught in universities in- 
sures its future. Finally, many software components are being developed in the 
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very-high-level languages used in specialized systems; MATLAB is the primary 
example. 

We are clearly facing a transition in computer languages for science and engi- 
neering computation. Numerical analysts no longer have much influence on the 
choice of language of those doing numerical computing. Language choices are 
more often made based on other considerations, such as the need for convenient 
and portable graphical user interfaces, visualization tools, and other critical 
system services. While such services are largely unavailable to Fortran pro- 
grammers wishing to develop portable systems, they are conveniently at hand 
in C, C++, and Java. The increased portability afforded by the widespread 
availability of Java Virtual Machines on Windows, Unix, and Apple platforms, 
has made Java a very attractive option. While mixed-language programming 
is possible, and docs provide the ability to reuse legacy Fortran software, this 
option is not popular among users. It adds complexity to the software project, 
while making the code more difficult to transport. 

Unfortunately, there is almost no support for the migration of the existing 
base of Fortran mathematical software components to other languages. As a 
result, this well-engineered software is being increasingly bypassed in favor of 
inferior home-grown solutions. 

3.3 The risks of self-publishing 

The rise of the Internet has greatly eased the exchange of information among re- 
searchers. It is simple and convenient for research groups to develop a Web page 
to distribute software and documentation to potential users. While this has led 
to increased access to research software, it places the long-term maintenance of 
the output of the research community in jeopardy. Project Web pages on de- 
partmental servers are not permanent fixtures. Nevertheless, many researchers 
are using such facilities in place of submitting their software to more permanent 
archives such as nethb or the Collected Algorithms of the ACM. There is a dan- 
ger that much of the currently available expertise embedded in such software 
will be lost to future researchers. 

4 Mathematical Software Future 

In this section, I offer a few predictions regarding future mathematical software 
research and usage. 

Prediction: Within five years ACM will cease print publication of TOMS. 

Subscriptions to TOMS have been dropping at the rate of about 5 percent per 
year for some time. Other ACM journals, and indeed most other mathematics 
and computer science journals, are experiencing the same phenomenon. One 
of the reasons for this is the proliferation of specialized journals, principally 
developed by commercial publishers. 
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For some time, ACM has been considering mechanisms for maintaining their 
pubhcation program as a viable service to the community. The solution to this 
problem is found in the ACM Digital Library (ACMDL) which premiered in 1998 
[0. The ACMDL provides its subscribers with online access to all ACM journal 
articles and conference proceedings published since 1985 at a subscription fee 
which is less than the cost of three printed journals. Currently this accounts for 
more than 350,000 pages of text. Acceptance of the ACMDL by members and 
subscribers has been overwhelming, providing ACM with the additonal revenue 
to begin the work of extending the ACMDL holdings to include all material 
published by ACM since its inception in 1947. At the same time, the success of 
the ACMDL has contributed to a further 25 percent drop in print subscriptions 
in 1999. If present trends continue, printed versions of ACM journals will be 
no longer be sustainable in five years time. Instead, they will be superceded by 
their electronic counterparts. 

The ACMDL will serve to blur the distinctions between individual ACM 
journals. The concept of a journal will be replaced by that of an input stream 
to the ACMDL controlled by a certification authority, i.e., a board of editors 
supported by volunteer referees. In such an environment, it will be much eas- 
ier (and much less financially risky) for ACM to initiate new refereed input 
streams, and to phase out those which have become less productive. Rather 
than subscribe to individual journals, ACMDL subscribers will have access to 
an individually tailored notification service which will alert them to the avail- 
ability of new articles in their areas of interest. 

Publications in the ACMDL will not be restricted to articles with a severe 
page limit. Extended appendices will be easily accommodated, as will other 
artifacts such as software, audio, video, etc. 

Prediction: Users will no longer install mathematical software on their work- 
stations. 

The need for instantaneous distribution and use of mathematical software 
components in heterogenous network environments will put new pressures for 
software portability. A key element of the solution will be standardized virtual 
environments in which software can execute. Java is an example of such an 
environment. Its widespread availability also provides a new model for software 
distribution. Complex conglomerations of source code will no longer need to 
be explicitly downloaded and installed on the local systems in advance of their 
use. Instead pre-compiled bytecodes for the virtual machine will be able to 
be downloaded from sites of developers or vendors on demand. This also pro- 
vides a solution to the problem of distributing patches and updates to software. 
Rather than purchasing an entire library, software users will have the option of 
subscribing to a service, paying only for the portions of the library that they 
actually use. 

Another new model for software reuse in a network environment is based 
on a remote execution paradigm. In this case, problem-solving services are 
made available to users over the network. When a problem need be solved, a 
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message containing a high-level specification of the problem is sent to the service 
provider, who provides both the software and the execution cycles needed to 
solve it. This model is probably more appropriate for access to large scale 
systems, like finite-element modeling packages. 

Prediction: The percentage of people directly using math software libraries 
will decrease. 

The wide availability of problem-solving environments (PSEs) for various 
domains will bring computational capabilities to an even wider audience than 
today. These users will make use of the services of the PSE, blissfully unaware 
of the complex system, involving software libraries, expert systems, and remote 
execution, which are being marshalled on their behalf. 

However, if this vision is to be realized, a new class of software designers 
must be trained. They must be well- versed in numerical analysis, mathematical 
algorithms, modern software design, and high-performance computing and com- 
munications. Additional research in mathematical software must be performed 
to provide new methods for improving the robustness and adaptibility of math- 
ematical software systems, and to address new problem areas. And finally, new 
methods for assessing the correctness and reliability of complex mathematical 
software systems must be devised and deployed. 

Mathematical software is still a vital and vibrant research area that will 
increase in importance in the coming decades. We are grateful to John Rice for 
his vision and leadership in getting us here. 
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